JOURNAL OF APPLIED MEASUREMENT, 16(3), 251-267 
Copyright 0 2015 


Using the Partial Credit Model 
to Evaluate the Student Engagement 
in Mathematics Scale 


Micela Leis 

Karen M. Schmidt 

Sara E. Rimm-Kaufman 
University of Virginia 


The Student Engagement in Mathematics Scale (SEMS) is a self-report measure that was created to assess 
three dimensions of student engagement (social, emotional, and cognitive) in mathematics based on a single 
day of class. In the current study, the SEMS was administered to a sample of 360 fifth graders from a large 
Mid-Atlantic district. The Rasch partial credit model (PCM) was used to analyze the psychometric properties 
of each sub-dimension of the SEMS. Misfitting items were removed from the final analysis. In general, items 
represented a range of engagement levels. Results show that the SEMS is an effective measure for researchers 
and practitioners to assess upper elementary school students’ perception of their engagement in math. The paper 
concludes with several recommendations for researchers considering using the SEMS. 


Requests for reprints should be sent to Micela Leis, University of Virginia, P. O. Box 800784, Charlottesville, 
VA 22904, USA, e-mail: ml3kc@virginia.edu. 
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Item fit. Within each of the three subscales of 3). Item 17 also had a weighted z-score above unexplained variance). No items were deleted attention in math when it was interesting” had a 

engagement, unidimensionality, fit statistics, item the critical value of 2 (Table 4). According to from this subscale. Person separation reliability weighted MNSQ of 1.33, and a z-score of 3.3. 

and person separation reliability, and increasing the guidelines suggested by Smith et al. (1998), for this four-item subscale was .62 for the 320 Upon further examination, we discovered that 

measures of ability across categories were exam- with a sample size of 357 participants, 1 . 1 1 is the non-extreme persons, and .66 for all 357 respon- not all the response categories had a probability 

ined in order to assess how well the data fit the guideline for which a weighted MNSQ should be dents. Item separation reliability was .98. of being selected. Collapsing categories together 
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